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ESTIMATING A MONOTONE TREND 

By Ou Zhao and Michael Woodroofe 

Yale University and University of Michigan 
Motivated by global warming issues, we consider a time se- 
ries that consists of a nondccreasing trend observed with station- 
ary fluctuations, nonparametric estimation of the trend under 
monotonicity assumption is considered. The rescaled isotonic es- 
timators at an interior point are shown to converge to Chcrnoff's 
distribution under minimal conditions on the stationary errors. 
Since the isotonic estimators suffer from the spiking problem 
at the end point, two modifications arc proposed. The estima- 
tion errors for both estimators of the boundary point are shown 
to have interesting limiting distributions. Approximation accu- 
racies are assessed through simulations. One highlight of our 
treatment is the proof of the weak convergence results which 
involve several recent techniques developed in the study of con- 
ditional central limit questions. These weak convergences can 
be shown to hold conditionally given the starting values. 

1. Introduction. Consider a time series that consists of a nondecreasing trend 
observed with stationary fluctuations, say 

yk = f^k + Xk, k = l,2,... 

where — oo < /ii < /i2 < ■ ■ ■ and . . . X^i, Xq, Xi, . . . is a strictly stationary se- 
quence with mean and flnite variance. The global temperature anomalies in 
Example 1 provide a particular example. If a segment of the series is observed, 
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2 O. ZHAO AND M. WOODROOFE 

say yi,...,yn, then isotonic methods suggest themselves for estimating the /i^ 
nonparametrically. The isotonic estimators may be described as 

~ . Vi^ \-yj 

(1) Uk = niax mm -. 

^ i<k k<j<n j — i + 1 

Alternatively, letting [x\ denote the greatest integer that is less than or equal to 
X G M, F„ the cumulative sum diagram, 

= yi + --- + yinti ^ 

n 

and Yn its greatest convex minorant, jlk = Y!^{k/n), the left hand derivative of Yn 
evaluated at t = k/n. See Chapter 1 of [10] for background on isotonic estimation. 

Example 1. Annual global temperature anomalies from 1850-2000 are shown 
in Figure [T] with the isotonic estimator of trend superimposed as a step function. 




Fig 1. Global Temperature Anomalies 



With the global warming data, there is special interest in estimating the 
current temperature anomaly, and there isotonic methods encounter the spiking 
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problem, described in Section 7.2 of [TO] for the closely related problem of estimating 
a monotone density. We consider two methods for correcting this problem, the 
penalized estimators of [12] and the method of [6], both introduced for monotone 
densities. The former estimates by 



where A„ > is smoothing parameter, and the latter by fib,n = l^m„i where < n 
is another smoothing parameter. 

The main results of this paper obtain the asymptotic distributions of estimation 
errors, properly normalized, for the estimators described above. One of these re- 
sults is well known for monotone regression with i.i.d. errors, and analogues of the 
others are known for monotone density estimation. Interest here is in extending 
these results to allow for dependence. Others have been interested in this question 
recently — notably Anevski and Hossjer p. Our results go beyond theirs in several 
ways. We consider the boundary case, estimating our results hold condition- 
ally given the starting values; and our conditions are weaker. Instead of the strong 
mixing condition, called (A9) in [1], we use the condition ([2]) below, introduced in 
|7] and further developed in [8]. One objective of this paper is to show by example 
how recent results on the central limit question for sums of stationary processes 
can be used to weaken mixing conditions in statistical applications. 

The main results are stated and proved in Section [3] and then illustrated by 
simulations in Section HI Section [2] contains some background material. 

2. Preliminaries. 

A maximal inequality and conditional convergence. The main results of [8] are 
an important technical tool. To state them, let . . . X_i, Xq, Xi, . . . be a strictly 
stationary sequence with mean and finite variance, as above; let 5*0 = 0, = 
Xl^ h X„, = a{. . . , and 




2/i H H 



•n 



B„(t) 




1 
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4 O. ZHAO AND M. WOODROOFE 

for < t < 1; and let B denote a standard Brownian motion. Both B and B„ are 
regarded as random elements with values in D[0, 1], endowed with the Skorohod 
topology, [2], Chapter 3. Let || ■ || denote the norm in L'^{P), \\Y\\ = ^EiY"^). It is 
shown in [8] that if 



(2) 

then 

and 
(3) 

(4) 



^n-i||E(5„|J-o)|| <oo, 



n=l 



E 



max Sl 



k<n 



< 6 



1 



n, 



a' = lim -E{S^ 



exists, and B„ converges in distribution to aB. In fact, a stronger conclusion is 
possible. It will be shown that the conditional distributions of B„ given JFq converge 
in probability to the distribution of crB. 

Properties of weak convergence — for example, the continuous mapping theo- 
rem and Slutzky's theorem, extend easily to the convergence of conditional dis- 
tributions. We illustrate with Slutzky's theorem [2]. Let (A", (i) denote a complete 
separable metric space, and let p be a metric that metrizes weak convergence of 
probability distributions on the Borel sets of X, for example the metric ([5]) below. 
Next, let X„, Y„, n = 1, 2, . . ., be random elements assuming values in X; suppose 
that X„ and Y„ are defined on the same probability space (f2„,^„,P„) say; let 
•A-n C An be sub sigma algebras; and let //„ and z/„ be regular conditional distri- 
butions for X„ and Y„ given A^- If fin) in probability and c/(X„, Y„) — > 
in probability, then p{fi, Vn) in probability. The assertion can be easily proved 
from the usual statement of Slutzky's theorem, for example, [2], page 25, by con- 
sidering subsequences which converge to oo so rapidly that — > and 
(i(X„, Y„) — i> w.p.l along the subsequence. 
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There is a convenient choice of p. Write ||5'||Lip = sup^. \g{x) \ + sup^.-^^ \9{.x) 
g{y)\/d{x,y) for bounded Lipschitz continuous functions g and let 

(5) p(/i, u) = sup 

ll9l|Lip<l 



gdfi - 
X Jx 



for probabihty distributions /i and v on the Borel sets of X. Then p metrizes 
convergence in distribution ([3], Theorem 11.3.3). Here is a useful feature of p. Let 
^ •An,'i be sub sigma algebras of An and let pn,\ and pn,2 be regular conditional 
distributions for X„ given An,\ and An,2- Then p{fi, pn,i) < /in,2)|-^ri,i] and, 

therefore, 

(6) E[p{fi, Pn,l)] < E[p{fi, fin,2)]- 

One more bit of preparation: If . . . X^i, Xq, Xi, ... is any stationary sequence 
for which E{X^) < oo, then X^/n w.p.l by an easy application of the Borel- 
Cantelli lemmas, or simply the ergodic theorem |9], page 30; thus, Xnj \fn 
with probability one. 

If 7 > 0, and m > is an integer, let 



(7) 



7 



for t > — m/7; and let = Xm^^|[a,6] denote the restriction of X^^-y to an 



interval [a,b]. Thus B„ = Xg^. Let W denote a standard two-sided Brownian 
motion. Both X^^^ and W^'* = W| [a, b] are regarded as elements of D[a, b]. 

Proposition 1. Suppose that ([^ holds; let run > he integers; let < 7„ — > 
00; and let —00 < a < b < 00. If either a > or '~fn/^n 0, then the conditional 
distribution ofX^'^^ .^^ given JFq converges in probability to the distribution ofaW^'^. 

Proof. For fixed a and b, write X„ = H'h'' ^ ; let $„ denote a regular con- 
ditional distribution for X.„ given J-'q and $ the distribution of crW"'''. Then it is 
necessary to show that $„] — in probability. 
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6 O. ZHAO AND M. WOODROOFE 

If a > 0, then it suffices to consider the case a = 0, since then the convergence 
of X^*;^ ^ imphes that of XJ^^ ^ . It also suffices to consider the case m„ = 0. To 
see why, suppose that the result is known for m„ = and let $° be a regular 
conditional distribution for Xq'^^ given jFg, so that lim„_»oo -E'[p($, $°)] = 0. Next, 
let $* be a regular conditional distribution for X„ given Tm^- Then £'[p($, $,„)] < 
E[p{^, $*)] by (E]), and -E'[p($, $*)] = -E'[p($, $^)] since the process is stationary. 
So, lim^^oo -E'[p(*^', '^'n)] = 0, as required. 

Thus consider the case that m„ = and a = 0. From [7] there is a martingale 
M„ with stationary increments and a sequence for which 0, and 

5^ = Mn + -Rn -p.l for all n. Let 

M„(t) = -^M\^^t\ and M„(t) = ^i?L7.tJ 

for < t < 6. Then, clearly X„ = M„ + M„ and M„(t) ^ in probability for each 
fixed < t < 6. Let \E'„ denote a regular conditional distribution(RCD) for M„ 
given JFq. Then p($, \E'„) — > w.p.l, by the functional version of the martingale 
central limit theorem, applied conditionally; see, for example, [5], Section 4. From 
[8] the (unconditional) distributions of X„ are tight. So, the (unconditional) dis- 
tributions of M„ are tight and, therefore, maxo<j<fe |IR„(t)| — in probability. The 
special case follows from the conditional version of Slutzky's theorem. 

Suppose now that 7n/?Tin and a < 0. Then, as above we may suppose 6 > 0. 
Let m* = m„ + [7„aJ and let n be so large that m* > 0. Then 

X„(t) = X||;t7^"Jt - a) - X[J;t;^"^(-a) + e„(t) 

for a < t < b, where 

\-^k I 

max 1 6^(^)1 < 2 max > 

a<t<b m„+7„a-l<A;<m„+7„b+l ^y^)^ 

in probability. So, it suffices to show that the conditional distribution of X* : = 
^mjyyl giveu jFg couverges to the distribution of crW in D[0,b — a]. Let $° be the 
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ESTIMATING A MONOTONE TREND 7 

distribution of aW in D[0,b-a], $° the RCD for Xj^^ given J^o, K ^ RCD for 
X* given jFg, and $** a RCD for X* given J^m* • Then, as above 

by dSD, stationarity, and the special case. □ 

Relation to strong mixing. The condition ([2]) may be compared with mixing 
conditions. Let Qn = (^{Xn, -^n+i? • • •} and recall that the strong mixing coefficients 
are defined by 

an= sup \P{AnB) - P{A)P{B)\. 
Then the condition of [1] may be stated: for some e > 0, 

E(Xf) < oo and ^ aV" < oo. (A9) 

n=l 

Proposition 2. // (A9) holds, then ^ holds. 
Proof. First write 



||E(5„|^o)|| = snpE[E{Sr^J'o)Y] = supE[5„F], 

Y Y 

where the supremum is taken over all jFg-measurable functions Y for which < 
1. By standard mixing inequalities, e.g.. Corollary A. 2 of [5J, Appendix III, 

\E{SnY)\ < J2 \E{XkY)\ < E8||Xfc||4n|2«| < 8||Xo||4E«| 

k=l k=l k=l 

for jFg-measurable function Y with ||1^||2 < 1, where || ■ ||p denotes the norm in L^. 
So, p(5„|J-o)|| < 8||Xo||4ELi«l and 

oo oo 1 

$:n-i||E(5„|J-o)|| <24||Xo||4E^«l- 

n=l k=l V 

Now let e be as in (A9); take max{l, 2 — 4e} < q < 2; and let p = q/{q — Then 
p > 2, and the right hand side of last line is at most 



24||Xo||4 



k=l 



.k=l 
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8 O. ZHAO AND M. WOODROOFE 

which is finite. □ 

Figure [2] shows the autocorrelation plot of the residual global temperature anoma- 
lies. This is consistent with a low order autoregressive model for which ([2]) is eas- 
ily verified. By way of contrast, a low order autoregressive process needs not be 
strongly mixing. (The Bernoulli shift process in [7] provides an example.) 

Series resid 



CO 

d 



CO 

ci 




CvJ 



5 10 15 

Lag 

Fig 2. Global Temperature Anomalies 



3. Asymptotic distributions. 

The LSE's. Throughout this section, we suppose that the trend /ifc changes 
gradually in the sense that 

(8) /ifc = 

where is a continuous, nondecreasing function on [0, 1]. Thus, Hk depends on n 
as well as /c, but the dependence on n will be suppressed in the notation. Let 
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ESTIMATING A MONOTONE TREND 9 

= f <i)(s)ds 
Jo 

and 

Ut) = Kit), 

the left hand derivative of the greatest convex minorant of Yn, for < t < 1. Then 

f^k = <Pn{k/n) and 

sup \^n{t)-m\=0{-]. 

A sequence C (0, 1) is called regular if either tn E (0, 1) as n — > oo 

or t„ — i> 1 and rA{l — tn) ^ i E (0, oo]. The first theorem obtains the asymptotic 
distribution of 

(9) En = n^4>n{tn) - (p{tn)] 

for regular sequences {tn}- Observe that if (f) is continuously different iable near to, 
then the asymptotic distribution, if any, is unchanged if t„ is replaced by [ntn]/n. 
So, for a regular sequence {tn}, we implicitly assume ntn are integers with each 
n = l,2,... . 

Let W be a standard two-sided Brownian motion as in Section El 

(10) Z{s) = aWis) + ^0'(to)s' 
for s G M, and 

(11) Zn{s) = ni [Yn{tn + n-h) - F„(t„) - </)(t„)n"^s 

for s G In '■= [—nHn, n^{l — tn)]- Then S„ = Z^(0), the left hand derivative of the 
greatest convex minorant of Z„ at s = 0. 

Proposition 3. Suppose that ^ and hold, is continuously differen- 
tiable near ^ (0, 1], and that 0'(to) > 0- Let tn — > to be regular and < i = 
lim„^oo''^^(l ~ tn) ^ oo. Then for — oo < a < b < i, the conditional distributions 
of Zn given JFq converge in D[a,b] to the (unconditional) distribution o/Z|[a,6]. 
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10 O. ZHAO AND M. WOODROOFE 

Proof. To begin, write 



(12) 



where 



Rnis), 



2 

713 



.{tn + n-h) - MM 



1 



and 



RJs) 



2 



It is clear that sup^gj^ \Rn{s)\ < 2n3 supo<t<i \^n{t) — ^{t)\ = 0{n s) ^ as 
n — ^ cx) and that 

hm ^n{s) = l(f)'{to)s'' 

n^oo 2 

uniformly on compactas. So, it suffices to show that the conditional distribution 
of W„|[a,6] given JFq converges to the distribution of (jW|[a,6] in D[a,b] for all 
compact subintervals [a,b] C (— oo,£]; and this follows easily from Proposition [H 

2 

To see how, let m„ = [nt„J, 7„ = ns, and observe that 



WJs) 



where maxa<s<b |e^(s)| — > in probability. □ 

Unfortunately, H,„ is not quite a continuous functional of Z„. The following 
two lemmas are needed to obtain its limiting distribution. The ffist is simply a 
restatement of Lemmas 5.1 and 5.2 of (TTj. If / : / ^ M is a bounded function and 
J C / is a subinterval, let G jf denote the greatest convex minorant of /| J. 

Lemma 1. Let f be a bounded piecewise continuous function on a closed inter- 
val I and [01,02] C [61,62] ^ I- If 

J a^ + bi \ Gif{a,) + Gif{b,) .^^^ 
V 2 ; 2 ' ^ ' ' 

then Gif = (^[61,62]/ on [01,02]. 
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Lemma 2. With the notations and conditions of Proposition^^ sup^gj-^[|W„(s)|- 
emin(s^, \s\)] is stochastically bounded for any e > 0. 

Proof. Let /+ = [0,n^l - t„)] and = [-nhn,0]. It will be shown 
that supggjH- — e min(s^, is stochastically bounded, the treatment of 

sup^gj- I — emin(s^, being similar. Let m.„(s) = [ntn + n^s\ — [nt„J for 

2 2 

s G In and observe that n^s — 1 < m„(s) < n^s. Then 



sup |W„(s)| — emin(s^, > c 
sei+ 



P 



\S, 



m„(s) I 



sup 1 

salt na 



emm s , s > c 



for fixed n >1 and c > 0. If c > 2, the term on the right is at most 



(13) 



P 



max \Sm\ > nsc 



2 

m<n3 



P 



max \bm\—n ^em>-n'ic 



n3 <m<n 

Then, using the maximal inequality ([3]), the right side of (fT3|) is at most 



IC I 1 i 

max Dm > -n^c 
2 ' ' 9 



/c=l 



max 

, 2 

< 24 



|^^|>^(c + e2^)ni 



^^ll' + 1S[c + e(2^-l)]- 



which is independent of n and approaches as c — * oo. □ 

Proposition 4. // the assumptions of Proposition hold with i = oo, then 
for any compact interval [01,02] C M and any e > 0, there is a compact interval 
[bi,b2] ^ [01,^2] such that 



(14) P Zn = G[fei,fe2]Z„ on [01,02] 



> 1 - e < P 



GrZ = G[b-^^b^]Z on [01,02] 



for all large n. 



Proof. Observe that \E'„ is convex in (fT2l) and let 7 = ^(j)'{to)- Then there are 
TT-o > 1 and (5 > for which uq > 1/6"^ and 

^7 < <P'{t) < y7 
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whenever \t — tn\ < S and n > uq. It then follows from a Taylor series expansion 
and convexity that for n > ng 



9 

10 



is' < *n(s) < 



11 

10 



7S 



for |s| < 5n3 and 
(15) 



9 / \ 

^n(s) > — 7min (s^, \s\j 



for all s G /„. Given e, there is a c such that for all large n, 



(16) 



P 



|-Rn(s)| < — 7min(s^, \s\) + c for all s & I„ 



> 1 



by Lemma [21 Let i?„ be the event defined on the left side of f|T6|) . Then i?„ implies 
Z„(s) > 8\I^„(s)/9 - c for all s G /„ and, therefore, Z„(s) > 8\&„(s)/9 - c for all 
s G In, since is convex. Let [01,02] be as in the statement of the proposition; 
let 62 > max{0, 02} be so large that 

ij + bl- 60262 > 20c; 

and let n > uq he so large that 02,62 £ -^n and max{|o2|, [62 1} < f^?^^- Then _B„ 
implies 

^02 + 62\ 



7 



2Z. 



Z„(o2) + Z„(62) 



^ 12 (a2 + h2 



:7 



+ 4c 



7 
'5 



60262 



4c, 



which is negative by the choice of 62- Similarly, for large n, implies the existence 
of hi < oi for which 2Z„[|(oi + 61)] < Z„(oi) + Z„(6i). The left side of ([HD then 
follows from Lemma [U the right hand inequality is similar, but simpler. □ 

Theorem 1 . // the assumptions of Proposition hold, then the conditional 
distributions of {GiJLn)\J given JFq converges in probability to the distribution of 
(G(_oo/)Z)|J for every compact interval J C (— oo,£), and the conditional distri- 
butions of En given JFq converge in probability to the distribution 0/ [G(„oo/)^]'(0). 
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Proof. We first consider the case I = oo. If J is any compact interval and 
e > 0, tlien tliere is a compact K sucli tliat 

(17) P [GiZn = GK^n on J] > 1 - e < P [G^Z = Gk^ on J] 

for all large n. Let $ and $° denote the distributions of (GkZ)| J and (G^^-Z)! J; and 
let and $° denote regular conditional distributions for (G/^Z„,)| J and (G^-Zn)! J 
given J^Q. Recalling p as defined in ([5]) with A* = D{J), then £'[p($°,$°)] ^ 0, 
by the continuous mapping theorem since the conditional distribution of Z^li^ 
converges to the distribution of Z\K. It follows that 

i?[p($, $„)] < p(<D, $°) + E[p($°, $°)] + i?[p($;;, $„)] < 3e 

for sufficiently large n, since p($, $°) < e and p($^, $n) < e w.p.l by Proposition 

SI 

Now suppose i < oo, and consider J = [01,02] ^ (— oo,£]. Following the proof 
of Proposition SI there is 61 < ai for which f|T7j) holds with = [bi,n^{l —tn)] for 
all large n, then the rest of the argument is similar as above. The second assertion 
of the theorem is an immediate consequence of the continuous mapping theorem. 
□ 

Corollary 1. Suppose ^ and ^ hold, then for t g (0, 1), 

(18) j 0n(t) -0(t) \ ^ 2argmin [w(s) + 

\ K J — oo<s<oo 

where k = [|cr^0'(t)]^; moreover, for < i < 00, 



(19) na 0„(l -£n-3) -0(1) 



G(_oo/] aW(s) + -0'(1) 



(O)-£0'(l). 



Proof. The convergence follows directly from Theorem [T] since the left side of 
( fT8l) . for example, is simply S„/ k by taking t„ = t. That [G]rZ]'(0) = 2k argminj,W(s) 
in distribution follows from rescaling properties of Brownian motion. □ 
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14 O. ZHAO AND M. WOODROOFE 

The penalized LSE. Now consider the penalized LSE. Clearly, 

_ Vn-k+l H h - (An + k)^n 

l^p,n - l^n — max — — - . 

l<k<n K -\- An 

The numerator here may be written as 

Vn-k+i H h 1/n - (A„ + k)^iri = ^p,n (k / u^) - A„ (fc/ni) - n'^Xnfin 

where 

and 

It is clear that the conditional distribution of Wp^n converges to the distribution of 
(tW in D[0,a] for all < a < oo. If (|8]) holds and is continuously different iable 
near 1, then 

hm A„(t) = 

n— »oo 2 

uniformly on compact subintervals of [0, oo); and if </>'(!) > 0, then there is an 
?7 > for which A,„(t) > for all 6n~^ < t < and n > 6. Suppose now that 
A„ = an^ for some < a < oo and let 



Wp,„(t) - A„(t) - 



t + a/n^/^ 

for < t < n^. Then n^{jlp^n — fJ-n) = inax.„-2/3<j<„i/3 

Theorem 2. Suppose that ^) and ^ hold, that continuously differen- 
tiable near 1, and that 0(1)0'(1) > 0. Then 

,n A'-n) ^ sup Zp^oo(^)) 
0<t<oo 



where 



_ aWjt) - a0(l) - 



t 

for < t < oo . 
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Proof. Clearly, Zp^„ Zp^oo in D{K) for all compact subintervals K C 
(0, oo). So, it suffices to show that for every e G (0, 1) there is a 5 > for which 



sup Zp„(t) = sup Ijp^nif) 



_ 2 1 
n <t<n'S 



5<t<5- 



> 1 -e 



for all large n; and for this it suffices to show that for every e G (0, 1), there is a 
5 > for which 



(20) 



sup Zp.„(t) > -- 

.n-2/3<t<5 £ 



P 



sup Zp.„(t) > 



1 



< e 



for all large n. The ffist term on the left side of fl20l) is easy. If 5 < ae/2, then 



sup Zp „(t) > — 

.n-2/3<t<5 ' e 



< P 



sup Wp,„(t) > 

0<t<(5 ^ 



which is less than e/2 for all large n if 5 is sufficiently small, since Wp.„ =^ crW in 
^[0, 1] and P[supo<t<5 W(t) > |a] = 2[1 - ^{a/{2V6)]. For the second, recall that 
there is an 77 > for which A„(t) > for all t < and consider S < er] and 
n > [e0(l)]-3. Then 



P 



sup Zp,„(t) > — 

.(5-i<t<ni ^. 



P 



< P 



Wpnit) > An{t) - -, for some t G [7,?t.3" 
e 

Sn - Sn-j > ?7 j for some j G [^ni,n] 



Let m = [5 ^nl\ Then by stationarity, the last term is at most 



k=l 



max Sj > 



•qm 2 



2o2fc-2 



n 



< 6 



n 



< 96 



l^oll' + r 



^2 



for large n, and this may be made less than e/2 by taking 5 sufficiently small. □ 

4. Simulations. Simulations were conducted to assess the accuracy of the 
approximation implicit in (fTSl) . Several things affect this, including the nature 
of the process . . . Xq, Xi, . . ., the function 0, the choice of t^, and the sample 
size. For the fluctuations, we considered an autoregressive process X^ = pX^^i+ek-, 
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where . . . e_i, eo, ei, . . . are i.i.d. normally distributed random variables with mean 
0. We considered two values of p, p = .5 and .9 representing moderate and strong 
dependence, three 0's, </)(t) = t^, t, and ^/i, and three values of to = 1/3, 1/2, and 
2/3. In each case the variance of . . . e_i, eo, ei, . . . was chosen to make ^jE\xf\ = 
.25. The sample size was n = 150. In many ways, these choices are consistent with 
the global warming example. For each choice of these values 10, 000 time series 
were generated and the empirical distribution function of H„/k was computed at 
selected percentiles of Chernoff's distribution [1]. The results are presented in the 
Tables 1, 2, and 3. 



Table 1 



p 


± 


1/3 


to 
1/2 


p = .5 
2/3 


mill 


max 


1/3 


to 
1/2 


p = .9 
2/3 


min 


max 


.025 


.0016 


.0142 


.0181 


.0225 


.0142 


.0225 


.0219 


.0104 


.0119 


.0102 


.0219 


.050 


.0022 


.0341 


.0406 


.0448 


.0323 


.0448 


.0443 


.0275 


.0303 


.0262 


.0443 


.100 


.0030 


.0773 


.0898 


.0939 


.0762 


.0950 


.0878 


.0676 


.0734 


.0673 


.0878 


.200 


.0040 


.1725 


.1907 


.1892 


.1717 


.1920 


.1808 


.1631 


.1660 


.1584 


.1808 


.250 


.0043 


.2231 


.2373 


.2398 


.2219 


.2440 


.2271 


.2140 


.2193 


.2067 


.2271 


.300 


.0046 


.2745 


.2906 


.2892 


.2706 


.2951 


.2761 


.2643 


.2723 


.2563 


.2761 


.400 


.0049 


.3781 


.3864 


.3902 


.3762 


.3962 


.3719 


.3683 


.3827 


.3581 


.3827 


.500 


.0050 


.4834 


.4915 


.4930 


.4786 


.4963 


.4738 


.4718 


.4925 


.4673 


.4929 


.600 


.0049 


.5908 


.5921 


.5962 


.5826 


.5990 


.5769 


.5805 


.5955 


.5729 


.6002 


.700 


.0046 


.6957 


.6893 


.6986 


.6852 


.6997 


.6765 


.6847 


.7068 


.6765 


.7068 


.750 


.0043 


.7448 


.7381 


.7470 


.7381 


.7521 


.7271 


.7400 


.7579 


.7271 


.7591 


.800 


.0040 


.7943 


.7942 


.7977 


.7889 


.8021 


.7818 


.7924 


.8087 


.7811 


.8121 


.900 


.0030 


.8947 


.8985 


.9014 


.8888 


.9021 


.8863 


.8980 


.9050 


.8863 


.9093 


.950 


.0022 


.9455 


.9491 


.9508 


.9442 


.9532 


.9383 


.9502 


.9556 


.9382 


.9556 


.975 


.0016 


.9709 


.9746 


.9763 


.9709 


.9781 


.9663 


.9759 


.9801 


.9660 


.9801 



Note: Cohmins three, four, and five show the empirical distribution function of scaled S„ at 
the p*'' percentile of Chernoff's distribution for to = 1/3, 1/2, and 2/3. The value of p is in 
column one, and column two lists the standard errors of the simulations. Columns six and seven 
list the minimum and maximum of the empirical distribution function over 1/S < to < 2/3. 
Columns eight through twelve provide the same information for p = .9 
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Table 2 

<f>{t) = t 



p 


± 


1/3 


to 
1/2 


p= .5 
2/3 


min 


max 


1/3 


to 
1/2 


p = .9 
2/3 


min 


max 


.025 


.0016 


.0417 


.0222 


.0135 


.0129 


.0417 


.0394 


.0202 


.0107 


.0104 


.0394 


.050 


.0022 


.0709 


.0468 


.0324 


.0320 


.0709 


.0674 


.0417 


.0266 


.0266 


.0674 


.100 


.0030 


.1246 


.0946 


.0731 


.0731 


.1246 


.1223 


.0880 


.0652 


.0652 


.1223 


.zUU 


.UU4U 


.zzzb 




1 71 Q 
.11 16 


.11 16 


0007 
.ZZZ ( 


oi Q c; 


.ioo4 


1 fim 
.ioUi 


1 fjni 
.ibUi 


oi Q c; 


.250 


.0043 


.2729 


.2472 


.2214 


.2214 


.2729 


.2642 


.2328 


.2105 


.2105 


.2651 


.300 


.0046 


.3169 


.2971 


.2723 


.2723 


.3169 


.3099 


.2848 


.2618 


.2618 


.3105 


.400 


.0049 


.4048 


.3987 


.3808 


.3808 


.4051 


.4044 


.3923 


.3781 


.3736 


.4044 


.500 


.0050 


.4923 


.5023 


.4899 


.4878 


.5058 


.4925 


.4983 


.4955 


.4877 


.5014 


.600 


.0049 


.5852 


.6050 


.6036 


.5820 


.6108 


.5851 


.6010 


.6111 


.5851 


.6154 


.700 


.0046 


.6785 


.7083 


.7150 


.6726 


.7194 


.6786 


.7052 


.7242 


.6786 


.7253 


.750 


.0043 


.7233 


.7567 


.7694 


.7194 


.7733 


.7254 


.7612 


.7826 


.7254 


.7826 


.800 


.0040 


.7718 


.8078 


.8215 


.7644 


.8249 


.7735 


.8107 


.8352 


.7735 


.8367 


.900 


.0030 


.8666 


.9031 


.9222 


.8666 


.9225 


.8737 


.9087 


.9295 


.8737 


.9304 


.950 


.0022 


.9245 


.9523 


.9667 


.9245 


.9689 


.9302 


.9564 


.9716 


.9302 


.9716 


.975 


.0016 


.9562 


.9755 


.9877 


.9562 


.9877 


.9615 


.9800 


.9887 


.9615 


.9887 



Note: See note to Table 1. 



Table 3 

m = vt 



p 


± 


1/3 


to 
1/2 


p=.5 
2/3 


min 


max 


1/3 


to 
1/2 


p = .9 

2/3 


min 


max 


.025 


.0016 


.0392 


.0130 


.0046 


.0046 


.0392 


.0444 


.0155 


.0040 


.0040 


.0444 


.050 


.0022 


.0695 


.0309 


.0151 


.0146 


.0695 


.0758 


.0328 


.0138 


.0138 


.0758 


.100 


.0030 


.1259 


.0770 


.0456 


.0456 


.1259 


.1292 


.0731 


.0422 


.0422 


.1292 


.200 


.0040 


.2270 


.1759 


.1354 


.1346 


.2270 


.2291 


.1742 


.1371 


.1371 


.2291 


.250 


.0043 


.2709 


.2284 


.1909 


.1892 


.2716 


.2771 


.2209 


.1907 


.1907 


.2780 


.300 


.0046 


.3193 


.2840 


.2496 


.2478 


.3219 


.3288 


.2819 


.2484 


.2484 


.3288 


.400 


.0049 


.4176 


.3925 


.3772 


.3759 


.4211 


.4263 


.3940 


.3723 


.3723 


.4271 


.500 


.0050 


.5088 


.5037 


.5060 


.5021 


.5194 


.5216 


.5146 


.5039 


.5028 


.5217 


.600 


.0049 


.6071 


.6154 


.6375 


.6050 


.6375 


.6111 


.6261 


.6296 


.6111 


.6343 


.700 


.0046 


.6979 


.7291 


.7581 


.6979 


.7620 


.7048 


.7386 


.7633 


.7048 


.7633 


.750 


.0043 


.7478 


.7831 


.8180 


.7478 


.8180 


.7532 


.7890 


.8198 


.7532 


.8198 


.800 


.0040 


.7966 


.8334 


.8730 


.7966 


.8734 


.8052 


.8421 


.8717 


.8052 


.8717 


.900 


.0030 


.8881 


.9312 


.9595 


.8881 


.9599 


.9029 


.9360 


.9584 


.9029 


.9584 


.950 


.0022 


.9424 


.9741 


.9869 


.9424 


.9875 


.9480 


.9759 


.9839 


.9480 


.9850 


.975 


.0016 


.9686 


.9897 


.9966 


.9686 


.9970 


.9728 


.9909 


.9948 


.9728 


.9948 



Note: See note to Table 1. 
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Table 4 

The Normalized Boundary Corrected Estimator 





= x/t 


= t 




z 


n = oo 


p = 


p=.5 


p=.9 


p = 


p=.5 


p = .9 


p = 


p=.5 


p = .9 


-2.5 


.0344 


.0426 


.0447 


.0503 


.0480 


.0370 


.0299 


.0399 


.0363 


.0216 


-2.0 


.0936 


.1054 


.1079 


.1144 


.1144 


.0981 


.0923 


.1033 


.1025 


.0786 


-1.5 


.1913 


.2129 


.2134 


.2212 


.2358 


.2076 


.2034 


.2135 


.2087 


.1905 


-1.0 


.3242 


.3603 


.3542 


.3697 


.3846 


.3508 


.3643 


.3588 


.3625 


.3609 


-0.5 


.4786 


.5137 


.5091 


.5237 


.5495 


.5135 


.5485 


.5221 


.5374 


.5551 


0.0 


.6293 


.6609 


.6608 


.6878 


.6989 


.6744 


.7103 


.6769 


.6926 


.7383 


0.5 


.7549 


.7784 


.7829 


.8109 


.8177 


.7972 


.8375 


.8019 


.8238 


.8724 


1.0 


.8483 


.8687 


.8734 


.9048 


.8988 


.8840 


.9170 


.8861 


.9047 


.9435 


1.5 


.9137 


.9303 


.9310 


.9570 


.9463 


.9391 


.9662 


.9390 


.9536 


.9828 


2.0 


.9568 


.9647 


.9660 


.9816 


.9746 


.9692 


.9877 


.9703 


.9811 


.9944 


2.5 


.9787 


.9832 


.9860 


.9935 


.9898 


.9872 


.9970 


.9874 


.9925 


.9988 



Note: Column 2 lists a Monte Carlo estimate of the asymptotic distribution function; columns 
3, 4, and 5, list estimates of the actual distribution function for n = 150, p = 0, .5, and .9, and 
^(i) = V^; columns 6, 7, and 8 provide the same information for = t, columns 9, 10, and 11 

for 4>(t) = t^. 



In Table 1, the agreement between the empirical distribution function and the 
limiting distribution seems generally better in the right tail than the left where 
the empirical is consistently less than the limiting distribution. In Table 2, the 
agreement is excellent at to = 1/2 but deteriorates markedly for to = 1/3 or 2/3. In 
Table 3, the empirical distribution of the absolute value appears to be stochastically 
smaller than the corresponding limit in all but two columns (to = 1/3). In all three 
tables the empirical distribution function is generally decreasing in to- This is 
easily explained by the numbers of maxima and minima in the Max-Min formula, 
([1]). Also, in all tables the difference between moderate and strong dependence is 
modest, suggesting that the effect of dependence is adequately captured in the 
calculation of a. 

Similar simulations showed that the approximations implicit in Theorem 2 and 
( IT9|) were not so good (depending on £) in the case of (fTOl) . Monte Carlo estimates 
of the distribution function of (fT9l) are listed in Table 4 for n = 150, p = 0, .5, 
and .9, and the same three functions along with the asymptotic distribution 
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Table 5 

The Normalized Penalized Estimator 





= x/t 


= t 




z 


n = oo 


p = 


p=.5 


p = .9 


p = 


p=.5 


p = .9 


p = 


p=.5 


p = .9 


-2.5 


.0393 


.0412 


.0470 


.0577 


.0379 


.0389 


.0363 


.0340 


.0314 


.0241 


-2.0 


.1122 


.1153 


.1331 


.1514 


.1065 


.1176 


.1283 


.1019 


.1067 


.1037 


-1.5 


.2380 


.2424 


.2779 


.3080 


.2354 


.2627 


.3045 


.2319 


.2596 


.2965 


-1.0 


.3952 


.4082 


.4552 


.5117 


.4077 


.4574 


.5511 


.4102 


.4646 


.4779 


-0.5 


.5582 


.5721 


.6416 


.6637 


.5934 


.6527 


.7592 


.6029 


.6717 


.7085 


0.0 


.7055 


.7265 


.7679 


.7985 


.7470 


.8038 


.8977 


.7611 


.8317 


.9304 


0.5 


.8169 


.8426 


.8903 


.9354 


.8553 


.9014 


.9674 


.8674 


.9277 


.9836 


1.0 


.8948 


.9186 


.9509 


.9861 


.9234 


.9581 


.9916 


.9366 


.9720 


.9975 


1.5 


.9401 


.9602 


.9810 


.9967 


.9650 


.9831 


.9995 


.9718 


.9908 


.9997 


2.0 


.9677 


.9821 


.9922 


.9993 


.9842 


.9932 


1.000 


.9884 


.9978 


1.000 


2.5 


.9837 


.9916 


.9974 


.9999 


.9923 


.9983 


1.000 


.9960 


.9996 


1.000 



Note: Column 2 lists a Monte Carlo estimate of the asymptotic distribution function; columns 
3, 4, and 5, list estimates of the actual distribution function for n = 150, p = 0, .5, and .9, and 
^{t) = \/t\ columns 6, 7, and 8 provide the same information for = t, columns 9, 10, and 11 

for (\)(t) = e. 



function. Similar results were obtained for the normalized penalized estimator and 
are presented in Table 5. While the agreement leaves much to be desired, the results 
are not without practical implications: at the very least they suggest that the 
limiting distributions are not highly sensitive to the distribution of the fluctuations, 
within broad limits; and this suggestion is confirmed in Tables 4 and 5 which show 
good agreement for the three values of p. 
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